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ABSTRACT \ . . 

A tforkshop was designed "to sensitize participants to 
the nature of their oiin intervention in teaching evaluation. The 
fSllowing served as research questions: fa) liil a workshop in 
self-evaluation inprove self- perception of teaching perforiance, the 
perception of an internal source of evaluation, and skill in 
self-evaluation of teaching perfornance? (bj What effect do different 
conditions of feedback have on the developnent of self -perceived 
teaching perfornance, the perceptions of an internal source of 
evaluation, and the development of self-evaluation skills? and (c) 
V±1X the participants react favorably toward the workshop variables? 
Thirty graduate students were randosly placed in three feedback 
treatment groups. All students videotaped, three aicrolessons and 
self -evaluated the«. These evaluations vere then compared with the 
^evaluations of a panel of experts. Augwented feedback was given to 
two of the treatoent groups in the forn of knowledge of the results 
of the two evaluations (keif and panel) and/or knowledge of results 
■and a group supervisory conference. Correlated t-tests for pre- and 
posttest neans phoned statistically significant results for the three 
dependent variables (self-perception, panel perception, and 
agreement). An analysis of co variance,, utilizing the pretest as a 
covariate, produced no significant differences between treatment 
groups. (Author) • . 
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Rationale 

The rationale for tfiis stutaSy is tteat pa.rt off the profes- 
sioaal responsibility of the tescteer is tSae development of com- 
petence in self-martitorinig teacfiser perfforaaoce* This concept 
prompted an investigation inta tbe effects of a worlisiiop xn 
self -evaluation of teac&img perfonsBaace latiba^iag' videotape 
feedback, peer group teacfeicig. aad Eiicrolessons^is a demonstra- 
tion vehicle- It was assnnaecfi that isssiglat into one's teaching 
behavior, the developmenit ol persasaal goals, at tesit ion to cri- 
teria, and the development of stspervision as self-vision are es- 
senti?*l elements in the formirlation of soumd supervise prac- 
tices. 

The workshop was designect to sessitize participants to the 
nature of their own intervest i©ni is teaching evaluation. Answers 
to the following questions were therefore sought: 

(1) Will a workshop in sel f^valasation iiaprove: ^\(a) self- 
perception of teaching perforaaace; (to) the perception of an ex- 
ternal source of evaluation; (c) skill in self-evaluat ion of 
teaching performance? 

(2) What effect do different conditions of feedback have 
on the development of self-perceived teaching perfonaance, the 
perceptions of an external source of evaluation, and the develop- 
ment of self-evaluation skills? 

(3) Will the participants react favorably toward the work- 
shop variables? 



The inv;estigator was concerned with research in sell-con- 
frontation via videotape recording, change resulting from such 
experiences, and the development of skill in self-evaluation. 
The review of the literature indicates that ^ self -conf rontation 
has met with widespread optimism. This optimism is shared by 
educators in terms of pre-service and in-service teacher train- 
ing. The bulk of the evidence from studies involving self -con- 
frontation, microteaching , videotape feedback, and self-anAlysis 
points to the effectiveness of these variables in producing 
change (Acheson, 1964; Allen, 1967; Allen and Ryan, 1969; 
Bern, 1967; Birch ^ 1969; Cameron and Cotrell, 1970; DeBacy , 
1969; Jensen, 1968; Kerber, 1967; Legge and Asper, 1972; 
Olivero, 1966; Ribich, 1972; Salomon and McDonald, 1970; and 
Young, 1968). 

This investigator sought to provide data covering a new 
dimension. The research indicates that comparisons between 
videotape feedback and a no videotape feedback condition or 
some other feedback condition such as audiotape have been made. 
It was considered important, therefore, to test the videotape 
feedback condition as basic to all treatments against augmented 
conditions . 

Sample 

t 

The sample 'population was drawn from a total of 39 gradu- 
ate students at Duquesne University Ivho registered for a work- 
shop in self-evaluation of teaching performance in May, 1974. 



Ail of the students were pursuing either a Mastjer^s degree in 
Elementary or Secondary Education or certification im school 
administration and supervision. THi^y represemted vat*ious and 
diverse backgrounds in administration, supervisfioss, and teach- 
ing. 

Thirty students were randomly selected as subjects for the 
study. Further randomization of tfee subjects pr«>^ti2ced ttaree 
treatment groups (n=10). None of tlie studeunts Siiad previoaas ' 
systematic experience in sell-nonitorieg tesctnisEg; performance 
via videotape recording. It -m^. assumed, tSierefore^ tbat tiie 
reactive effect of the videotar,- recording mould he the same 
for all subjects. 

Organization of the Study 

The studyf^was comprised of two phases. OcuriKg pbase one, 
a panel^'of experts, members of the faculty in tbe Schcx>l of Edu- 
cation at Duquesne University, was trained in tbe use of the 
Teacher Performance Appraisal Scale (Johnson, 1969). The TPAS 
was used as the criterion measure to obt'ain thr^ scores: (1) 
self-perception of teaching performance; (2) panel of experts" 
perception of teaching performance; and (3) a^eeoseEst- The io- 
strument has been used £?s a device for providing corrective feed- 
back to pre-service and practicing teachers- It conceptyal izes 
four principal lesson elements: aims, content, method, aod 
evaluation. There are 10 items on the scale with a range of 
1-7. 
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Pre-study interrater reliability coefficients of .80 or 
better were demonstrated by the panel of experts. Random sam- 
ples during the study also showed .80 reliability or better. 

Also during phase one, the subjects of the study were 
given an orientation in the use of the TPAS and were apprised 
of the procedures to be followed. No one was aware of his 
assignment or the nature of the treatment until feedback con- 
ditions were employed during the first intertape period. Ea.ch 
subject was assigned a number for identification. Thus, the 
panel of experts, with the exception of the investigator, was 
not aware of the treatment group assignments. 

The subjects were instructed to use a mode of instruction 
which suited them, to choose the content for the lesson, to 
supply matarials or aids if appropriate for the lesson, and to 
limit the time of the lesson to seven minutes. The class to be 
taught consisted of 12 other participants in the workshop. 

During phase two, the subjects recorded and evaluated micro- 
lessons over a two-week period. Three separate recording and 
evaluating sessions were conducted. Each of these sessions was 
interspersed with an intertape period during which feedback con- 
ditions were employed. The assessment of attitude and a reaction 
session were the last items in this phase. 

Design and Treatment Conditions 

A pre-test/post~test control group design was selecte'd 
(Campbell and Stanley, 1966). Each treatment group received 
videotape feedback via self-viewing of his own teaching per- 
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formance. Thus, Group I which did dot received aoy augnented 
feedback served as the control group. Group II recei%'ed agu- 
merited feedback in the form of a transcript which shoveil how 
well each participant in the group had agreed with tSie pa^el 
of experts about his performance. Group III received augol^nted 

\ 

\ 

feedback in the form of the transcript plus the opportunity to 
participate in a group supervisory conference. 

The first evaluation served as the pre-test and the tbird 
evaluation served as the post-test. The second evaluation and 
the two intertape periods served as the t j^eatment • Thus, feed- 
back conditions were employed after the first and second evalu- 
ations. 

Terms 

To clarify the terrr Logy m the study, the following 
definitions were made: 

.(1) Self-evaluation: the self-perception and self -evalu- 
ation of teaching performance as measured by the Teacher Perform- 
ance Appraisal Scale and determined by viewing a videotaped re- 
cording of one's own teaching performance. 

(2) Teaching performance: A videotaped microlesson quanti- 
tatively expressed as the mean of the item scores on the TPAS. 

(3) Microlesson: A lesson of seven minutes duration taught 
by a participant to 12 other participants. 

(4) Videotape recording: The recording of teaching perform- 
ance which can be replayed and monitored via the videotape re- 
corder . 

. (5) Feedback: The result of viewing one's own teaching per- 
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lormance via videotape recording. 

(6) Augmented feedba^2iw The knowledge of results the sub- 
ject, receives of agreement between his self-evaluatioas aad the 
evaluations of a panel of experts via transcript or transcript 
plus a group conference. 

(7) Transcript: A form which indicates the results of 
the self-evaluc*^ js per item, the mean panel evaluation per 
item, the agreement per item, and a mean agreement score. 

(8) Non-directive group conference: A conference in which 
the supervisor a ;ks general questions about the videotaped teach- 
ing performances and the results of the evaluations.. He offers 
no advice or direction as wh)^t the subject should attend to 

or do on a subsequent teaching jierformance. 

Dependent Variables 

/ 

/ 

In order to define the dependent variable concerned with ; 
self-perception of teaching performance, the mean of the item 
scores on the TPAS for each subject self-evaluat ion was calcu- 
lated to yield a self-perception of teaching performance on 
the first and third evaluations. The mean of the self-perception 
scores was calculated for the total sample. This yielded the ex- 
tent and direction of the self-perceived teaching performance 

for the sample. The mean of the self-perception scores was then 

\ 

calculated for each treatment group. Th:s yielded the extent 
and direction of the self-perceived teaching performance for 

each treatment group. 

In order to define the dependent variable concerned with the 
panel of experts' perceptions of the teaching performances, a 
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panel of experts' item score mean on the TPAS for each subject 
was calculated on the. first and third evaluations. This yielded 
the extent and direction of the panel's perception of teaching 
performance for the sample. Panel perception score raeaos were 
then calculated for each treatment group. 

Each evaluator on the panel rated each subject independent- 
ly, and the investigator was the only one aware of the treatment 
group assignments. This awareness did not interfere with his ob- 
. jectivity at any time. Each subject was identified by number 
only, and at no time were the other two panel members aware of 
subject scores. 

The strategy used to define the dependent variable con- 
cerned with agreement between the subject and the p^nel was to 

compare scores. In order to measure the overall extentj to which 

"i 

the self-evaluation was congruent with the panel, an agreement 
score was obtained. For each item on the TPAS, the deviation 
of the subject's self-evaluation score from the mean of the 
panel's scc-re v;as calculated. The mean deviation of the items 
yielded tLe .agreement score. This represented the extent of de- 
velopment of self-evaluation skill. An agreement score of 1.00 
or more was construed as disagreement. An agreement score of 
less than 1.00 was construed as agreement. Pre-test and post- 
test calculations were made for the total sample and for each 

» 

treatment group. . ^ 

A Scale for Measuring Attitudes Toward Any Practice, Form 
A (Remmers, 1960), was used to assess subject attitude toward 
attitude variables Identified in^the study. The m'edian scale 

/ 



value of the statements endorsed was calculated for the total 
sample and for each treatment group. 

statistical Analysis 

Correlated tests were used to test the following hypothe- 
ses: 

Ho 1: There will be no difference in self-perception be- 
tween pre-test and post-test means for subjects in the workshop 
in self -evaluation of teaching performance. 

Ko 2: There will be no difference in teaching performance 
between pre-t^st and post-test means-'as evaluated by a panel of 
experts for the subjects in^ the workshop. 

Ho 3: Tjtiere will be no difference in agreement between 
/-pre-test and post-test means for subjects in the workshop. 

Using the pre-test as a covariate, an analysis of covari- 
a^^e was used to test the following hypotheses: 

Ho 4: There will be no difference between treatment groups 
in self -percept ion of teaching performance. 

Ho 5: There will be no difference between treatment groups 
as evaluated by a panel of experts. 

Ho 6: There will be no difference between treatment groups 

on agreement. 
Results 

Table 1 shows that the workshop was effective in producing 
positive results with regard to each dependent variable. Sig- 
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nificant results indicate that the subjects as a whole had 
progressed. 



Table 1. Correlated 


t Tests fqr Pre-test and Post- 


-test Means 


Variable 


Pre-test 


SD Post-test 


SD df 


t 


Self 


5.01 


.762 5.45 


.388 29 


2.78** 


Panel 


4.02 


.942 5.20 


. 796 29 




Agreement 


1.34 


.655 .68 


.353 29 


4.50*** 


**Signif lea 


1 . 

iit at .01 




***Signif icant at .001 


Table 


t 

2 shows that there were no 


significant 


differences 



between treatment groups on any of the dependent variables. 



Table 2. Analysis of CoyAriance for Differences Between Treat- 
ment Groups Utilizing: Pre-test Scor es as Covarxate — 

Comparison ' df Alpha P ^ 



Self 
Panel 




.05 .28 1.32 

.05 .11 2.38 



^Agreement 2/26 .05 -24 1.46 



Table 3 shows that all subjects had high positive attitudes 
toward the variables assessed. No differences were found be- 
tween treatment groups. Any scaled ^^re above 6.00 is con- 
sidered positive. 
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Table 3. Average Scaled Attitude Scores After Third Evalu- 



ation 



Variable 


Group I 


• 

Group II 


Group III 


Avg . 


Peer group 
teaching 


7.90 


8.57 


8.56 

/ 


8.34 


Videotape 
feedback 


8.03 


8.57 


8.29 


•8.29 


Microlesson 
£us demonstra- 
tion vehicle 


8.34 


8.49 


8.39 


8.40 


condition 


7.25 


7.66 


8.6(5 


7.83 


PriLctice of 
sQlf -evalu- 
ation ' 


8.22 


8.67 


8. .55 , 


8.68 


Lxmitations of 


the Study 








This study 


was conducted 


i 

with the 


acknowledgment 


of the 



following limitations: 



(1> Subjects were selected from registrants in a workshop 
in self-evaluation of teaching performance. 

(2) The invest igatorx^was directly involved in the study 
ss (a) the director of the wojikshop; (b) the director of both 
panel and subject orientat ipns ; (c) one of the members of the 
.-panel of experts; and (d) the group conference supervisor. 

(3> No criteria such as age, sex, position, teaching ex- 
perience, or the like were considered. 

Piscussion 

Significant post-test d?,fferences for the total sample on 
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each_ dependen t variable and high positive attitudes toward the 
variables employed in the workshop indicate the following: 

(1) The videotape as a leedback medium is a powerful 
dynamic in producing change, 

(2) Peer group teaching, videotape feedback, mierolessons , 
and self-evaluation can be combined as valuable teacher training 
tools. Twenty subjects increased in self -percept ion of teaching 
performance; twenty-five der^ vnstrated skill development in self- 
evaluation; and panel evaluations indicated that twenty-seven 
subjects had improv^ed in teaching performance, 

(3) Given orientation to criteria, training, and feedback, 
it seems that teachers can attend to their purposes and modify 
behavior accordingly. 

(4) Highly favorable attitudes indicate that teachers might 
receive with favor the variables employed in this study as part 

of a school supervis on program. Researchv on-site is recommended. 




An analysis of covariance produced no dkignificant differ- 
ences between treatment groups. One could conclude, therefore, 
that the (dynamic of the videotape feedback was powerful enough 
in itself to produce desirable results. However, several com- 
ments regarding this outcome seem warranted: 

(1) It vis noteworthy that the data revealed that only four 
subjects in the control group showed increase in sel f -percept ion 
of teaching performance, while 7 of 10 in Group II, and 9 of 10 
in Group III saw themselves as doing a better job of teaching. 



Concomitantly, the average trend in score points between pre- 
test and post-test was +.09 for the control group, +.15 for 
Group II, and +.42 for Group III. Subjects in the control 
group confirmed that the-, felt a need for interaction or some 
form of augmented feedback; that neutrality was developing; 
and. that without some basis for comparison they we're becoming 
disinterested as well as more self-CriticaJ^. 

Subjects in Group II felt that the production of numbers 
on a transcript or rating scale did not lend much meaning to- 
ward goal attainment. Thus,/ affective considerations became 
quite important within the cognitive operation of the workshop. 
The supervisory treatments for the control group and for Group 
H did produce significant cognitive results, but there was ex- 
pressed affective disruption. Because these treatments are akin^. 
to many current practices in supervision in the schools - teacherfe 
are asked to evaluate their own behavior without comparative bases 
and without interaction with the supervisor - additional research 
combining cognitive and affective models is highly recommended. 
Extent ions of augmented feedback and treatments in time, quanti- 
ty, and quality should bo considered. 

(2) It is possible that the criterion measurement instru- 
ment caused a celling effect . A range of 1-7 per item did not 
permit adequate discrimination, particularly when subjects felt 
restrained in marking themselves at the 7 level. 

In summary, the workshop was successful in sensitizing the 

participants to the nature of their own intervention in teaching 

/ 
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evaluation. This tends to support the results of previous ^ 
•studies in this area of concern. Additional research is recom- 
mended with the emphasis on the videotape as the basic feedback ^ 
medium. Cognitive factors should be researched, but concern for 
affective factors should be considered using model"s of super- 
vision as treatment. 
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